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1.  SCOPE.  This  document  describes  methods  and  techniques  necessary  to 
perform  a  logistic  supportabil ity  test  of  Aviation,  Air  Delivery  Equipment, 
and  Aircraft  Weapons  Subsystem  in  a  cold  regions  environment. 


2.  FACILITIES,  EQUIPMENT,  INSTRUMENTATION,  AND  SUPPORT  REQUIREMENTS. 


2.1  Facilities 

Characteristic 

Runway 
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Characteristic 
Shops  and  hangar  space. 


Office  and  administration  work  area. 
Calibration  shop. 

2.2  Equipment 
Item 

Standard  tool  set. 

Maintenance  support. 

Comparison  items 

2.3  Instrumentation 
Item 

Stop  watches 

Temperature  measuring  devices 
Anemometer 


Minimum  Requirements 

Hangar  space  and  shop  w/capabil- 
ity  to  perform  organizational 
(Aviator  Unit  Maintenance)  (AVUM) 
and  up  to  Aviator  Intermediate 
Maintenance  (AVIM)  level  mainte¬ 
nance. 

Sufficient  to  accommodate  the 
test  team. 

Capable  of  calibrating  maintenance 
tools  and  test  equipment  furnished 
to  support  the  test  item. 


Minimum  Requirements 

Operator  level,  organizational 
AVUM  level  of  maintenance  auth¬ 
orized  to  support  the  test  item. 

To  include:  Draft  publications, 
repair  parts,  accessories,  special 
and  common  tools,  support  and 
ground  handling  equipment,  multi¬ 
purpose  test  equipment. 

When  specified. 


Minimum  Accuracy 

±0.1  second  (less  than  1%  error) 

1°C  (±2°F) 

±2% 


2.4  References 

2 

2.4.1  Army  Regulation  70-10  ,  Test  and  Evaluation  During  Development  and 
Acquisition  of  Material. 

3 

2.4.2  Army  Regulation  200-2  ,  w/change  1,  Environmental  Quality,  En¬ 
vironmental  Effects  of  Army  Actions,  dated  1  September  1981. 


2 


.y 


«.  V  -  *  V  ' 


4 

2.4.3  Army  Regulation  385-16  ,  Systems  Safety  and  Engineering  Manage¬ 

ment,  dated  10  December  1980. 

2.4.4  AMC  Regulation  70-13®,  w/TECOM  Supplement  1,  16  August  1982, 

Test  and  Evaluation  —  Incidents  Disclosed  During  Materiel  Testing. 

2.4.5  AR  70-38®,  Research  Development  Test  and  Evaluation  of  Material 
for  Extreme  Climatic  Conditions. 

2.4.6  AMC  Regulation  70-8'7,  w/TECOM  Supplement  1,  AMC  Value  Engineer¬ 

ing  Program,  dated  27  November  1978. 

2.4.7  AMC  Regulation  385-26®,  Aviation  Safety,  w/TECOM  Supplement  1, 

dated  22  September  1980. 

g 

2.4.8  AMC  Regulation  700-15  ,  Integrated  Logistic  Support  Performance 

Evaluation  Report,  w/TECOM  Supplement  1,  dated  20  June  1980. 

2.4.9  MIL-STD-1472C*0,  Human  Engineering  Design  Criteria  for  Military 
Systems,  Equipment,  and  Facilities,  dated  2  May  1981. 

2.4.10  TOP  7-3-5061*,  Safety  {Aviation  Materiel),  dated  18  January  1982. 

2.4.11  TOP  1-1-01212,  Classification  of  Deficiencies  and  Shortcomings, 

dated  1  April  1979. 

2.4.12  Requirements  documents  (LR,  ROC,  etc.). 

2.4.13  FM  9-2071®,  Operation  and  Maintenance  of  Ordnance  Materiel  in  Cold 
Weather  (0°  to  -65°F),  dated  January  1978. 

2.4.14  MIL-STD-882A^,  System  Safety  Program  Requirements,  dated  6  June 
1980. 

3.  PREPARATION  FOR  TEST. 

3.1  Facilities.  The  test  facilities  should  be  in  normal  operating  con¬ 
dition  with,  as  a  minimum,  those  maintenance  shops  required  to  keep  the  test 
item  and  support  equipment  equipped  and  functioning. 

3.2  Equipment.  The  initial  inspections  and  operational  checks  will  norm¬ 
ally  be  conducted  as  part  of  the  arrival  inspection  subtest  for  the  item. 
However,  project  personnel  must  insure  that,  as  a  minimum,  the  checks  out¬ 
lined  in  the  draft  equipment  publications  are  made.  When  a  reference  or 
comparison  item  is  used,  it  should  be  subjected  to  the  same  tests  as  those 
applied  to  the  test  item. 

3.3  Instrumentation.  Instrumentation  should  be  checked  for  accuracy  and 
calibrated  for  the  temperatures  at  which  it  will  be  used  prior  to  starting 
the  test. 


3.4  Data  Required.  Accurate  timing,  recording,  and  analysis  of  all  mainte- 
nance  actions  are  essential  in  determining  whether  the  maintenance  criteria 
for  the  test  item  are  met.  This  can  be  done  only  by  means  of  a  detailed, 
accurate  data  collection  system. 

4.  TEST  CONTROLS.  Maintenance  is  performed  as  appropriate  by  qualified 
personnel,  normally  military  with  appropriate  Military  Occupational  Special¬ 
ty  (MOS)  at  each  maintenance  level  as  specified  in  the  acquisition  plan  and 
in  accordance  with  the  draft  maintenance  allocation  chart.  This  maintenance 
will  be  conducted  using  the  tools,  test,  calibration  and  diagnostic  equip¬ 
ment,  and  maintenance  shop  facilities  of  the  same  type  that  will  be  issued 
to  the  field  for  support  of  the  end  item  or  system. 

5.  PERFORMANCE  TEST.  Testing  of  logistic  supportability  will  normally  be 
conducted  simultaneously  and  in  conjunction  with  other  test  operations. 
Separate,  independent  test  functions,  real  or  simulated,  will  be  performed 
as  required  to  insure  a  complete  exercise  of  all  the  logistic  supportability 
aspects  of  the  test  system.  The  scope  of  the  logistic  supportability 
testing  will  encompass  all  subelements  listed  below,  consistent  with  the 
availability  of  support  element  and  the  maturity  of  the  test  hardware. 
These  data  should  be  delineated  in  the  detailed  test  plan. 

-  End  item  requirements 

-  Supply  support 

-  Technical  data /equipment  publications 

-  Support  and  test  equipment 

-  Manpower  and  personnel,  training,  and  training  devices 

-  Transportation  and  handling 

-  Facilities 

-  Stowage 

The  basic  subelements  may  be  further  subdivided  to  enhance  the  clarity  and 
understanding  of  an  individual  subtest.  Subelement  breakouts/divisions  are 
usually  dependent  upon  the  maturity  and  complexity  of  the  test  system  and 
test  constraints  (time,  dollars)  placed  on  the  test  effort.  Specific  cri¬ 
teria  for  each  subelement  test  must  be  extracted  from  program  documentation 
IEP/TDP  (requirements,  specifications,  purchase  description  etc.).  Although 
the  logistic  supportability  test  is  subdivided,  the  evaluation  of  the  sub¬ 
elements  is  a  constant  overlapping  effort.  As  maintenance  and  repair  are 
being  performed,  manuals,  repair  parts,  tools,  test  measurement,  and  diag¬ 
nostic  equipment  (TMDE)  and  the  adequacy  of  new  equipment  training  are 
continually  being  evaluated.  The  following  is  a  brief  explanation  of  each 
logistic  supportability  test  subelement  listed  above  and  specific  guidance 
to  conduct  each  logistic  supportability  subelement  test. 

5.1  End  Item  Requirements.  This  subelement  of  the  logistic  supportability 
test  contains  a  quantitative  and  qualitative  analysis  of  maintainability  for 
the  test  system.  The  quantitative  analysis  will  quantify  the  logistic 
supportability  through  calculation  of  the  maintainability  indices.  The 
qualitative  analysis  will  assess  the  overall  design  characteristics  for  good 
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maintainability.  These  subtests  complement  each  other  and  provide  insight 
as  to  the  maintainability  of  the  test  item/ system. 

5.1.1  Quantitative  Analysis  (Maintainability  Indices).  Unless  otherwise 
directed,  the  quantitative  analysis  will,  as  a  minimum,  reflect  the  follow¬ 
ing  logistic/maintainability  indices: 

-  Operational  availability  (Ao) 

-  Achieved  availability  (Aa) 

-  Inherent  availability  (Ai) 

-  Mean-time-to-repair  (MTTR) 

-  Maintenance  Ratio  (MR) 

-  Maximum  corrective  maintenance  downtime  (Mmax) 

Definitions  of  these  indices  have  been  taken  from  TECOM  Supplement  1  to  AMC 
Regulation  700-15y  and  are  presented  in  appendix  D. 

a.  Data  Required.  The  demonstrated  quantitative  measures  of  the 
logistic  supportabil ity  are  recorded  within  this  subelement.  To  be  ident¬ 
ified  is  each  scheduled  and  unscheduled  maintenance  action.  Each  mainte¬ 
nance  action  must  be  carefully  assessed  and  accurately  documented  to  include 
the  following  essential  information  (see  end  of  maintenance  action  question¬ 
naire,  appendix  C): 

(1)  What  maintenance  tasks  were  performed  and  the  difficulties 
encountered  (if  any)  while  performing  the  maintenance  action.  Special 
emphasis  will  be  placed  on  performing  maintenance  outdoors  under  the  pre¬ 
vailing  weather  conditions  while  wearing  the  cold/dry  uniform. 

(2)  Record  of  what  necessitated  the  maintenance  action,  where  it 
was  performed  and  when  it  was  completed. 

(3)  Complete  description  of  the  maintenance  action. 

(4)  Identification  (model,  series,  serial  number,  etc.)  of  the 
system/subsystem/component  requiring  the  maintenance  action. 

(5)  Determination  whether  the  action  was  scheduled  or  unsched¬ 
uled. 

(6)  Classification  as  to  maintenance  category,  crew,  AVUM,  and 
AVIM.  In  the  test  arena,  this  classification  is  oftentimes  assessed  by  pro¬ 
ject  personnel  knowledgeable  as  to  the  complexity  of  the  maintenance  action 
and  the  Army  maintenance  concept. 

(7)  Maintenance  timeline  correlating  number  of  personnel  required 
and  time  expended  on  each  maintenance  task  to  include  the  time  devoted  to 
troubleshooting,  active  maintenance  (repair),  and  logistic  delay  (supply, 
administration,  etc.). 
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(8)  Service  time  (hours,  rounds,  miles,  cycles,  etc.)  accumulated 
on  the  test  item  when  the  maintenance  action  was  required. 

(9)  Record  of  all  parts  which  were  repaired  or  replaced  and  POL 
products  replaced  due  to  contamination  or  loss.  Parts  and  consumables  will 
be  identified  by  noun  nomenclature,  national  stock  number  (NSN),  functional 
group  number,  and  part  number,  as  available. 

(10)  Whether  the  maintenance  was  performed  outdoors  under  the 
present  weather  conditions  or  under  shelter. 

(11)  Air  temperatures  and  wind  chill  during  maintenance  action. 

(12)  Clothing  the  mechanics  were  wearing  during  the  maintenance 


action. 


TECOM  Supplement 


(13)  Complete  the  supportability  analysis  chart  in 
lement  1  to  AMC  Regulation  700- 15  . 


accordance  with 


b.  Analysis.  Based  on  the  data  recorded  in  paragraph  (1)  above, 
compute  the  maintainability  indices  presented  in  paragraph  a  as  required  by 
the  Test  Design  Plan  (TDP)  and/or  other  controlling  documents.  Indices 
should  be  computed  for  the  primary  equipment  and  separately  for  the  support 
and  test  equipment.  All  values  used  in  computing  the  indices  will  be  in¬ 
cluded  with  the  computations  in  the  test  report.  As  a  minimum,  each  of  the 
maintainability  indices  will  be  computed  in  accordance  with  the  point  esti¬ 
mate  equations  (based  on  the  normal  distribution)  presented  art:  appendix  D  in 
compliance  with  TECOM  Supplement  1  to  AMC  Regulation  700-15  .  However,  in 
many  cases,  other  assessment  methodology  appears  more  appropriate.  Appendix 
E  provides  an  outline  with  supportive  discussion  to  accomplish  a  minimum 
maintainability  analysis.  Determine  whether  the  test  item  meets  the  main¬ 
tainability  design  requirements  as  specified  by  the  requirements  document  or 
other  established  criteria. 

5.1.2  Qualitative  Analysis  (Design  of  System  for  Maintainability).  This 
subtest  evaluates  maintainability  design  features  to  determine  if  tne  design 
requirements  have  been  met.  Good  maintainability  design  features  will 
include: 

-  Modular  construction 

-  Ease  of  access  while  wearing  the  cold-dry  uniform 

-  Ease  of  access  to  batteries  and  adequacy  of  space  in  battery 
compartment 

-  Built-in  self-test  features 

-  Readily  accessible  test  points 

-  Mechanical  features  such  as:  Quick  connector,  built-in  work 
platform,  adequate  work  space,  protective  devices  (guards,  covers,  ground¬ 
ing,  etc). 
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a.  Data  Required.  Evaluate  each  of  the  above  design  features  and 
make  an  assessment  whether  the  difficulty  involved  and  time  needed  to  ac¬ 
complish  a  particular  maintenance  operation  is  considered  excessive  based  on 
experience  with  similar  equipment.  Safety  is  always  a  consideration  when 
data  is  collected. 

g  (1)  In  compliance  with  TECOM  Supplement  1  to  AMC  Regulation 
700-15y  comment  on  whether  the  test  item  is  designed  as  follows: 

(a)  To  minimize  maintenance  and  supply  requirements  through 
attainment  of  optimum  durability  and  service  life  of  materiel. 

(b)  To  eliminate  field  maintenance  problems  encountered  in 
earlier  design  items. 

(c)  For  ease  of  maintenance  while  wearing  the  cold-dry  uniform  by 
assuring  accessibility  to  facilitate  inspection,  repair,  and  replacement. 

(d)  For  maximum  interchangeability  of  components. 

(e)  For  maximum  detection  of  conditions  which  will  adversely 
affect  the  conduct  of  maintenance  operations  or  generate  excessive  mainte¬ 
nance  and  supply  requirements. 

(f)  To  achieve  maximum  compatibility  of  maintenance  operations 
with  common  tools  and  test,  measurement,  and  diagnostic  equipment  (TMDE). 

(g)  To  enable  removal  of  major  components  as  individual  units  and 
when  feasible,  to  use  standardized  components  which  are  compatible  with 
similar  equipment  already  in  the  military  system. 

(h)  To  facilitate  cleaning.  Report  adverse  effects  of  steam 
cleaning  if  this  method  of  cleaning  is  appropriate. 

(i)  To  insure  equipment  is  not  easily  damaged  when  subjected  to 
abnormal  operations,  abuses,  or  overloads  for  short  periods  of  time. 

(j)  Adequacy  of  marking  of  test  points,  circuits,  and  connectors. 

(2)  Interview  mechanics  after  each  maintenance  action;  evaluate 
and  record  the  following: 

(a)  Adequacy  of  hoisting,  lifting,  and  towing  provisions  required 
for  maintenance. 

(b)  Ease  of  maintenance  tasks. 

(c)  Physical  effort  required  for  performing  maintenance. 

(d)  Adequacy  of  working  space  for  performing  maintenance. 
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(e)  Simplicity  in  servicing  and  performing  maintenance  duties. 

(f)  Effects  of  engine  fumes  on  mechanics  during  maintenance. 

(g)  Freedom  of  the  mechanics  to  reach  and  work  adequately  as 
influenced  by  the  configuration  or  placement  of  components,  or  by  the  mech¬ 
anic's  clothing  or  size  (cold-dry  uniform). 

(h)  Servicing  factors  such  as  lubrication  of  equipment,  replen¬ 
ishing  tanks  and  reservoirs. 

(i)  Whether  standard  parts  and  tools  are  used. 

(j)  Adequacy  of  system  and  personal  protective  devices. 

(k)  Comments  and  recommendations  for  improvement. 

b.  Analysis.  All  data  collected  in  sections  5.1.1  and  5.1.2  above 
reflect  on  the  design  of  the  test  system  for  maintainability.  These  data 
must  be  integrated  into  a  unified  assessment  of  the  characteristics  of  the 
test  system  to  be  maintained  in  accordance  with  the  TDP  or  other  controlling 
documents. 

5.2  Supply  Support.  Supply  support  data  are  required  to  determine  the 
overall  logistic  supportability  of  the  test  item/system.  The  substitution 
of  unauthorized  repair  parts  is  not  authorized.  Supply  data  generated 
during  the  development  test,  particularly  parts  consumption  data,  will 
assist  logistic  personnel  to  determine  the  required  logistic  support  for  the 
test  item/system. 

5.2.1  Data  Required.  Throughout  the  conduct  of  the  test,  do  the  fol¬ 
lowing  and  record  appropriate  data,  as  required: 

a.  For  each  maintenance  action,  examine  all  replacement  parts  to 
determine  interchangeability. 

b.  Assess  repair  part  design  for  ease  of  installation,  alignment,  and 
checkout. 


c.  Evaluate  nonstandard  parts  to  determine  if  they  can  be  replaced 
with  standard  items  already  in  the  logistic  system. 

d.  Examine  repair  parts  with  respect  to  the  prescribed  maintenance 
category  authorized  to  stock  and/or  requisition  the  items.  Repair  parts 
authorized  at  each  maintenance  level  should  be  consistent  with  the  authoriz¬ 
ation  of  tools  and  equipment  to  accomplish  the  repair  action. 


e. 


Examine  repair  parts  to  evaluate  modular  design  criteria. 


f.  Compare  repair  parts  with  parts  manuals  to  determine  if  data  in 
the  parts  manual  are  adequate  for  identification  and  requisition  by  logistic 
personnel  in  the  field. 

g.  Complete  the  supply  support  chart  in  accordance  with  TECOM  Supple¬ 
ment  1  to  AMC  regulation  700-15y  for  each  maintenance  action. 

5.2.2  Analysis.  Assess  the  impact  of  each  supply  support  anomaly  un¬ 
covered  in  relation  to  the  test  item.  Include  comments  as  to  the  qualita¬ 
tive  effects  of  supply  support  inadequacies  on  the  maintenance  indices 
calculations,  paragraph  5.1.1  above. 

5.3  Technical  Data/Equipment  Publications.  The  subtest  is  conducted  to 
insure  that  the  test  item  technical  data/equipment  publications  are  technic¬ 
ally  adequate,  complete,  and  easily  understood  by  the  maintenance  personnel 
for  whom  they  are  intended.  Each  manual  must  be  evaluated  at  the  appropri¬ 
ate  maintenance  level  for  compliance  with  the  military  specifications  and 
standards  prescribing  format,  technical  content,  and  standards  of  production 
(MIL-M-38784BiD) .  Comments,  as  appropriate,  will  be  made  (by  separate 
correspondence  or  by  EPR)  to  the  preparing  agency  with  information  copies  to 
the  AMC  Materiel  Readiness  Support  Activity  and  appropriate  US  Army  Training 
and  Doctrine  Command  (TRADOC)  agencies.  TOP  1-2-609  1  (IMAGES),  provides  a 
repeatable,  systematic,  and  quantifiable  method  for  analyzing  technical 
data/equipment  publications.  Special  emphasis  will  be  placed  on  that 
section  of  the  technical  data/equipment  publications  pertaining  to  operation 
under  unusual  conditions-cold. 

5.3.1  Data  Required.  Each  maintenance  action  performed  during  the  test 
will  be  done  in  accordance  with  specific  procedures  provided  in  the  appro¬ 
priate  publication.  All  test  item  operations  and  inspections  will  be  con¬ 
ducted  IAW  the  specific  procedures  provided  in  the  appropriate  publication. 
Complete  technical  data/equipment  publication  chart  in  accordance  with  TECOM 
Supplement  1  to  AMC  Regulation  700-15  . 

5.3.2  Analysis.  Evaluate  the  technical  data/equipment  publications 
subjectively  and  quantitatively.  As  a  minimum,  address  the  following 
issues : 

a.  Simplicity,  clarity,  and  completeness  of  the  manuals  commensurate 
with  the  training  and  skills  of  the  targeted  operational  and  maintenance 
personnel . 

b.  Adequacy  and  completeness  of  troubleshooting  instructions. 

c.  Adequacy  and  completeness  of  the  preventive  maintenance  proce¬ 
dures. 

d.  Adequacy  and  completeness  of  safety  instructions  to  personnel  and 
equipment. 


e.  Adequacy  and  completeness  of  environmental  protection  instructions 
during  operation  and  maintenance  actions. 

f.  Adequacy  and  completeness  of  lubrication  and/or  other  servicing 
charts.  Identify  lubrication  or  other  servicing  commodities  not  in  the  Army 
supply  system. 

g.  Errors  and  omissions  in  nomenclature  and  stock  numbers  on  repair 
parts  or  special  tools. 

h.  Adequacy  of  instruction  commensurate  with  the  level  of  skill  and 
previous  training  of  the  operational  and  maintenance  personnel.  Identify 
additional  of  special  training  requirements  and  inadequacies  pertaining  to 
cold  weather  operation  and  maintenance. 

i.  Inadequacies  or  suggested  improvements  to  equipment  publications 
will  be  reported  on  DA  Form  2028  or  IMAGES  Forms  if  IMAGES  is  used. 

5.4  Support  and  Test  Equipment.  This  subelement  of  the  Logistic  Support- 
ability  Test  is  conducted  to  determine  the  adequacy  of  the  support  and  test 
equipment  provided  in  the  system  support  package.  All  maintenance  performed 
on  the  test  item  will  be  accomplished  using  the  test  and  support  equipment 
provided  in  the  system  support  package. 

5.4.1  Data  Required 

a.  For  each  maintenance  action,  complete  the  Support  and  Test  Equip* 
ment  Chart  in  accordance  with  TECOM  Supplement  1  to  AMC  Regulation  700-15y 
and  record  the  following: 

(1)  Maintenance  category  prescribed  and  recommended  for  use  of 
each  item  of  support  and  test  equipment. 

(2)  Comments  on  adequacy  of  support  and  test  equipment  for  in¬ 
tended  use. 

(3)  Comments  on  adequacy  of  printed  instructions  for  use  of 
support  and  test  equipment. 

(4)  Comments  on  whether  the  support  and  test  equipment  is  exces¬ 
sive  or  could  be  replaced  with  common  items. 

b.  Identify  any  support  and  test  equipment  needed  but  not  available 
in  the  system  support  package. 

c.  Identify  any  problems  associated  with  the  use  of  common  support 
and  test  equipment  during  maintenance  or  checkout  of  the  test  item/system. 


5.4.2  Analysis.  Discuss  any  problems  associated  with  the  use  of  common 
support  and  test  equipment  with  respect  to  the  test  item/system. 
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5.5  Personnel,  Training,  and  Training  Devices.  This  subelement  of  the 
Logistic  Supportability  Test  is  designed  to  evaluate  the  overall  interfaces 
between  the  personnel,  training  and  equipment  required  to  maintain  and 
operate  the  test  item/system.  The  training  devices  addressed  in  this  sub¬ 
element  are  those  provided  in  the  system  support  package  for  support  of  the 
test  item/system. 

5.5.1  Data  Required.  Issues  to  be  addressed  within  this  subelement 
should  be  available  in  the  Test  Design  Plan  (TDP),  Independent  Evaluation 
Plan  (IEP),  or  other  controlling  document.  If  specific  data  requirements 
are  not  available,  the  following  data  elements  should  be  addressed: 

-  Adequacy  of  number  of  personnel  projected  in  the  maintenance 
concept  required  to  logistically  support  the  test  item. 

-  Appropriateness  of  the  MOS  and  skill  level  of  the  prescribed 

personnel . 

-  Adequacy  of  personnel  training  to  perform  the  logistic  support- 
ability  function. 

-  Adequacy  of  the  training  devices  to  accomplish  the  training 
mission  in  support  of  the  logistic  supportability  function. 

1  O 

TOP  7-3-501  entitled  "Personnel  Training,"  addresses  each  of  the  above 
issues  and  should  be  utilized  as  appropriate. 

5.5.2  Analysi s 

18 

a.  Analyze  the  data  recorded  in  compliance  with  TOP  7-3-501  and 

address  the  following  issues  in  the  test  report. 

(1)  Methods  used  to  train,  update,  and  familiarize  test  personnel 
with  the  test  item/system,  as  related  to  the  training  planned  for  the  field 
operation. 

(2)  Suitability  of  training  documents. 

(3)  Maintenance  level  MOS,  skill  level,  and  number  of  personnel 
projected  for  each  major  maintenance  task. 

(4)  Additional  training  requirements  identified  during  test 

conduct. 


(5)  Effectiveness  of  training  in  terms  of: 

-  Meeting  all  training  requirements. 

-  Trainees'  ability  to  comprehend  and  effectively  perform  the 
required  instructions/maintenance  tasks. 
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-  Number  of  times  trainee  needed  assistance  from  higher 
maintenance  level  or  contractor  personnel  and  why. 

b.  Identify  any  incident/accident  which  resulted  from  a  lack  of 
training.  Determine  potential  seriousness  and  suggest  corrective  actions. 

5.6  Transportation  and  Handling.  This  subelement  of  the  Logistic  Support- 
ability  Test  addresses  the  adequacy  of  the  procedures  and  hardware  provided 
for  transport  of  the  test  system  in  a  nonmission-performirig  mode.  This 

implies  handling  the  test  system  in  accordance  with  its  transportability 
scenario  (e.g.,  on-load/off-load  and  transport  of  the  item  by  government  or 
commercial  carriers  utilizing  appropriate  handling  components).  This  sub¬ 
element  is  not  normally  evaluated  as  it  is  not  usually  cold-weather  related. 
The  cold  weather  considerations  deal  with  the  adequacy  of  the  new  equipment 
packing  and  packaging  (to  include  repair  parts  RPSTL  items).  TOP  1-2-50019 
should  be  used  as  a  guide  in  the  conduct  of  testing. 

5.6.1  Data  Required.  Test  issues  and  data  required  to  evaluate  the 

transportability  and  handling  characteristics  of  the  test  item/system  should 
be  available  in  the  TDP,  IEP  or  other  controlling  documents.  However,  if 
specific  guidance  is  not  available  and  other  test  agencies  will  not  be 

testing  this  same  item,  the  following  data,  if  collected  and  evaluated,  will 
generally  satisfy  this  subtest: 

a.  Physical  characteristics  to  include: 

(1)  Physical  description  to  include  basic  envelope  dimensions 
(length,  width,  height)  for  each  component  or  group  of  components  packaged 
together  (in  the  shipping  configuration)  during  transport. 

(2)  Weight  and  cubage  for  each  item/shipping  package. 

(3)  Center  of  gravity  for  each  item/shipping  package. 

(4)  Location  and  handling  limitations  for  each  hard  point  (lift¬ 
ing  and  tie  down  attachments). 

b.  Identify  each  piece  of  equipment  required  to  load  or  unload  the 
test  item. 

c.  Determine  transporter  and  handling  equipment  characteristics: 

(1)  Mode  (air,  rail,  truck,  etc.). 

(2)  Weight  and  handling  limitation  (hard  points,  lifting  and  tie 
down  attachments). 

(3)  Floor  loading  constraints. 

(4)  Center  of  gravity  envelope  for  cargo  compartment. 
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(5)  Loading  ramp  angles  and  crest  angle. 

(6)  For  external  he'^copter  transport,  record  the  complete  rig¬ 
ging  setup  (orientation,  attach  points,  tether  length,  swing  envelope)  and 
flight  constraints. 

d.  Record  the  following  data  during  transport  of  the  test  item  in  its 
operational  scenario: 

(1)  Record  of  displacement  (pitch,  yaw,  roll)  of  the  transporter. 

(2)  Record  of  test  item  deflections  correlated  to  transporter 
displacement. 

(3)  Record  of  floor  loading  caused  by  the  test  item  during  trans¬ 
port. 

(4)  Record  critical  clearances  during  loading  and  transport. 

(5)  Damage  to  test  item  caused  by  loading,  unloading,  or  trans¬ 
porting  the  test  item  as  applicable. 

(6)  Damage  to  transporter  or  handling  equipment  incurred  during 
loading,  unloading,  or  transporting  the  test  item,  as  applicable. 

e.  Prepare  a  loading  diagram  and  record  the  center  of  gravity  of  the 
transporter  loaded  with  the  test  item. 

f.  Record  the  degree  of  disassembly  required  for  loading  and  trans¬ 
port,  as  required. 

g.  Record  any  special  servicing  or  preparation  of  the  test  item 
required  for  loading  and  transport. 

h.  Record  measurements  of  shock  and  vibration  forces  sustained  by  the 
test  item  during  transport. 

i.  Completed  checklists  of  appendix  E  to  TOP  7-3-506*1. 

5.6.2  Analysis.  Assess  the  data  gathered.  Address  all  criteria  state¬ 
ments  concerning  transportability.  Qualitatively  address  the  following: 

a.  The  ease  or  difficulty  of  loading,  unloading,  and  transport  of  the 
test  item. 

b.  The  adequacy  of  handling  devices  (sling,  spreader  bars,  hooks, 
handles,  etc.). 

c.  Human  factors  engineering  of  the  handling  and  transport  method¬ 
ology. 
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d.  Safety  (personnel  and  equipment)  of  the  transportability  method¬ 
ology. 

e.  Mission  impact  resulting  from  test  item  damage  sustained  during 
handling  or  transport  as  applicable. 

f.  Extent  of  preparation,  packing,  and  packaging  of  the  test  item 
prior  to  transport. 

g.  The  relative  ease  or  difficulty  of  converting  from  operational  to 
transport  configuration,  and  back  to  operation,  in  the  required  time  frame. 

h.  Security  of  the  test  item  during  preparation,  transport,  and 
reassembly. 


Adequacy  of  special  handling  equipment,  devices,  fixtures,  or 


Jigs. 


j.  Adequacy  of  technical  documentation  for  air  transportability. 

5.7  Facilities.  Facilities  are  normally  not  evaluated,  but  if  evaluated 
include  all  physical  assets  (buildings,  fixtures,  runways,  ranges,  etc.)  and 
their  organizational  components  (TDA  structure,  personnel,  and  equipment) 
required  to  accommodate  a  specific  functional  requirement  germane  to  the 
logistic  support  of  the  test  item/system.  Training  requirements  should  not 
be  overlooked,  as  well  as  facilities  required  for  storage  of  repair  parts, 
spares,  and  data.  The  materiel  developer  should  provide  unique  facility 
requirements  for  test  purposes,  e.g.,  special  data  processing/reduction 
equipment,  special  test  checkout/calibration  and  maintenance  equipment,  etc. 
This  data,  in  conjunction  with  the  logistic  support  knowledge  gained  through 
test  experience  locally  and  at  the  contractor  support  level,  will  provide 
the  test  officer  some  insight  into  the  facilities  required  in  the  field 
environment.  As  applicable,  the  facility  planning  documents  provided  by  the 
materiel  developer  should  be  consulted  and  the  proposed  facilities  evaluated 
in  accordance  with  the  issues,  criteria,  and/or  requirements  included  in  the 
IEP  or  TDP. 

5.7.1  Data  Required.  The  logistic  supportabil ity  function  encompasses 
all  support  activities  associated  with  the  operation,  maintenance,  servi¬ 
cing,  storage,  repair  parts  system,  and  training  of  personnel  to  support  the 
test  item/system.  As  a  minimum,  record  the  following  data: 

a.  Instances  where  a  facility  (government,  contract,  or  commercial) 
utilized  during  test  was  inadequate  to  accomplish  the  logistic  supporta¬ 
bil  ity  function  for  which  it  was  intended. 

b.  Instances  during  test  where  a  facility's  physical  location  (gover¬ 
nment,  contractor,  or  commercial)  adversely  affected  the  logistic  support- 
ability  of  the  test  item. 
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c.  Instances  where  a  facility's  physical  environment  (temperature, 
ventilation,  contamination,  cleanliness,  etc.)  adversely  affected  the  logis¬ 
tic  supportability  of  the  test  item. 

d.  Instances  where  a  facility's  standard  fixed  equipment  (government, 
contractor,  commercial)  would  not  readily  perform  a  logistic  supportability 
function  for  the  test  item/system. 

5.7.2  Analysis.  Using  test  data  recorded  above  on  existing  facilities 
and  issues  and  requirements  extracted  from  the  appropriate  requirements 
documents,  qualitatively  assess  as  to  whether  the  facilities  projected  are 
adequate  for  the  logistic  supportability  function  for  which  they  were  in¬ 
tended.  As  a  minimum,  address  the  data  collected  above  and  extrapolate 
potential  impact  on  the  logistic  supportability  facilities  planned  for  the 
test  item/ system.  Also  address  the  following: 

a.  Comment  on  whether  all  logistic  supportabil ity  equipment  planned 
for  the  projected  test  item  support  facility  is  required. 

b.  Comment  on  whether  the  planned  fixed  equipment  can  be  installed 
and  operated  in  existing  facilities  without  adversely  affecting  other  on¬ 
going  facility  functions. 

5.8  Stowage 

This  subelement  of  the  Logistic  Supportability  Test  addresses  the 
adequacy  of  the  storage  space  provided  for  basic  issue  items  (BII),  troop 
installed  authorized  items,  publications  and  cold  weather  combat  gear. 

5.8.1  Data  Required 

Test  issues  and  data  required  to  evaluate  the  stowage  requirements 
should  be  available  in  the  IEP,  TDP  or  other  controlling  documents.  How¬ 
ever,  if  specific  guidance  is  not  available,  the  following  data,  if  collect¬ 
ed  and  evaluated  will  generally  satisfy  this  subtest. 

a.  Comments  of  crew  chiefs,  maintenance  evaluators  and  test  super¬ 
visory  personnel  pertinent  to  the  adequacy  of  the  space  and  protection 
provided  for  aircraft,  air  delivery  equipment,  and  aircraft  weapons  sub¬ 
systems. 

b.  Physical  checks  of  items  in  stowage  for  damage  after  each  mission. 

5.8.2  Analysis 

Evaluate  the  data  gathered.  Assess  all  criteria  statements  concerning 
stowage.  Qualitatively  address  all  problems  with  stowage  encountered. 


6.  DATA  REDUCTION  AND  PRESENTATION.  Data  reducjtion/analysis  and  presenta¬ 
tion  will  be  IAW  the  TDP  and  TECOM  Pamphlet  70-3  . 

6.1  Data  Reduction/Analysis.  Data  reduction  in  general  involves  identify¬ 
ing,  correlating,  and  organizing  raw  test  data  into  data  sets  which  can  be 
analyzed  to  form  a  complete  and  comprehensive  picture  of  the  overall  logis¬ 
tics  supportability  of  the  test  item.  Each  test  incident  will  be  analyzed 
to  determine  the  implication/impact,  if  any,  to  each  of  the  logistic  sup- 
portability  subelements  presented  in  paragraph  5,  Performance  Test.  Address 
each  problem/deficiency  cited  in  each  of  the  logistic  supportability  subele¬ 
ments  and  qualitatively  relate  its  impact  on  the  maintenance  indices  cal¬ 
culated  in  the  end  item  requirements  subelement. 

6.2  Data  Presentation.  Prepare  a  narrative  of  the  test  results  to  include 
diagrams,  photographs,  tables,  and  other  reduced  data  as  required,  to  sup¬ 
port  the  test  conclusions  and  recommendations.  Establish  the  degree  to 
which  the  test  item/ system  logistic  supportability  satisfies  the  test 
criteria. 


Recommended  changes  to  this  publication  should  be  forwarded  to 
Commander,  US  Army  Test  and  Evaluation  Command,  ATTN:  AMSTE-AD-M, 
Aberdeen  Proving  Ground,  MD  21005-5055.  Technical  information 
may  be  obtained  from  the  preparing  activity:  Commander,  US  Army 
Cold  Regions  Test  Center,  ATTN:  STECR-MT-P,  APO  Seattle,  WA 
98733-7850.  Additional  copies  are  available  from  the  Defense 
Technical  Information  Center  (DTIC),  Cameron  Station,  Alexandria, 
VA  22304-6145.  This  document  is  identified  by  the  accession 
number  (AD  No)  printed  on  the  first  page. 
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APPENDIX  A 
PRETEST  CHECKLIST 


1.  Have  facilities,  test  equipment,  instrumentation,  and  support  require¬ 
ments  been  scheduled  or  secured?  See  paragraph  2  of  this  TOP.  YES 
NO  . 


2.  Has  appropriate  test  planning  been  accomplished  in  accordance  with 

paragraph  3,  this  TOP?  YES _  NO _ . 

3.  Have  test  control  measures  been  implemented  such  that  test  results 
could  be  duplicated  or  compared?  See  paragraph  4,  this  TOP. 

YES _  NO _ . 

4.  Have  all  test  personnel  been  briefed  on  the  test  procedures?  YES 
NO  . 


A-l 


APPENDIX  B  -  POST-TEST  CHECKLIST 


1.  Have  test  data  been  collected,  recorded,  and  presented  in  accordance 
with  this  TOP?  YES  NO  .  Comment: 


l.  Have  all  data  collected  been  reviewed  for  correctness  and  completeness? 
(ES  NO  .  Comment: 


3.  Were  the  facilities,  test  equipment,  instrumentation,  and  support 
accommodations  adequate  to  accomplish  the  test  objectives?  YES _  NO _ . 


4.  Were  the  test  results  compromised  in  any  way  due  to  insufficient  test 
planning?  YES _  NO _ .  Comment: _ 


5.  Were  the  test  results  compromised  in  any  way  due  to  test  performance 
procedures?  YES _  NO _ .  Comment: _ 


6.  Were  the  test  results  compromised  in  any  way  due  to  test  control  pro 
cedures?  YES  NO  Comment: 


7.  Were  the  test  results  compromised  in  any  way  due  to  data  collection, 
reduction,  or  presentation?  YES _  NO _ .  Comment: _ 


Question  2.  The  following  questions  pertains  to  equipment  publications 
a.  Were  the  publications  complete? 


6  -  Extremely  Adequate 
5  -  Very  Adequate 
4  -  Adequate 
3  -  Adequate  at  Times 
2  -  Very  Inadequate 
1  -  Extremely  Inadequate 


b.  Comments: 
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c.  Were  the  publications  accurate? 

_ 6  -  Extremely  Accurate 

_ 5  -  Very  Accurate 

_ 4  -  Accurate 

_ 3  -  Accurate  at  Times 

_ 2  -  Very  Inaccurate 

_ 1  -  Extremely  Inaccurate 

d.  Comments: 


I  . 

e.  Were  the  publications  easy  to  read? 

_ 6  -  Extremely  Easy 

_ 5  -  Very  Easy 

_ 4  -  Easy 

_ 3  -  Difficult  at  Times 

_ 2  -  Very  Difficult 

_ 1  -  Extremely  Difficult 

f.  Comments: 


i 


g.  Were  the  publications  easy  to  follow? 

_ 6  -  Extremely  Easy 

_ 5  -  Very  Easy 

_ 4  -  Easy 

_ 3  -  Difficult  at  Times 

_ 2  -  Very  Difficult 

_ 1  -  Extremely  Difficult 


h.  Comments: 


i.  Adequate  instructions  to  complete  maintenance  actions? 

_ 6  -  Extremely  Adequate 

_ 5  -  Very  Adequate 

_ 4  -  Adequate 

_ 3  -  Adequate  at  Times 

_ 2  -  Very  Inadequate 

_ 1  -  Extremely  Inadequate 

j.  Comments:  _ 


k.  Adequate  instructions  for  part  requisitioning? 

_ 6  -  Extremely  Adequate 

_ 5  -  Very  Adequate 

_ 4  -  Adequate 

_ 3  -  Adequate  at  Times 

_ 2  -  Very  Inadequate 

_ 1  -  Extremely  Inadequate 

l.  Comments:  _ 


Question  3.  Did  you  encounter  any  difficulties  performing  the  maintenance 
action  in  any  of  the  following  areas? 

a.  Maintenance  operations? 

_ 6  -  Extremely  Easy 

_ 5  -  Very  Easy 

_ 4  -  Easy 

_ 3  -  Difficult  at  Times 

_ 2  -  Very  Difficult 

_ 1  -  Extremely  Difficult 


b.  Comments: 


c.  Working  space? 


_ 6  -  Extremely  Adequate 

_ 5  -  Very  Adequate 

_ 4  -  Adequate 

_ 3  -  Adequate  at  Times 

_ 2  -  Very  Inadequate 

_ 1  -  Extremely  Inadequate 

d.  Comments: 


e.  Use  of  tools  and  test  equipment? 

_ 6  -  Extremely  Adequate 

_ 5  -  Very  Adequate 

_ 4  -  Adequate 

_ 3  -  Adequate  at  Times 

_ 2  -  Very  Inadequate 

_ 1  -  Extremely  Inadequate 

f.  Comments: 


g.  Changing  replaceable  components  (such  as  filters,  belts,  etc.? 

_ 6  -  Extremely  Easy 

5  -  Very  Easy 
_ 4  -  Easy 

_ 3  -  Difficult  at  Times 

_ 2  -  Very  Difficult 

_ 1  -  Extremely  Difficult 


h .  Comments 


KO  LO  CO  CVJ  «— » 


Lubrication,  replenishing  tanks  and  reservoirs,  etc.? 


-  Extremely  Easy 

-  Very  Easy 

-  Easy 

-  Difficult  at  Times 

-  Very  Difficult 

-  Extremely  Difficult 


Comments: 
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APPENDIX  D  -  MAINTAINABILITY  INDICES  DEFINITIONS 


a.  Operational  availability 

Ao  =  _ Operating  Time  +  Standby  Time _ 

Operating  Time  +  Standby  Time  +  Scheduled  and  unscheduled 
maintenance  time  +  Logistic  +  Administrative  downtime 

b.  Achieved  availability  (Aa). 

Aa  =  _ Operating  Time  _ 

Operating  time  +  Scheduled  and  unscheduled  maintenance  time 

c.  Inherent  availability  (Ai). 

Ai  =  _ Operating  Time  _ 

Operating  time  +  Unscheduled  (corrective)  maintenance- time 

d.  Mean-time-to-repair  (MTTR). 

MTTR  =  Total  unscheduled  active  maintenance  time _ 

Total  number  of  unscheduled  active  maintenance  tasks 

e.  Maintenance  ratio  (MR).  Compute  for  each  category  of  maintenance 
including  overall  MR. 

MR  =  Total  scheduled  and  unscheduled  (corrective)  active 

maintenance  man-hours _ _ 

"Total  operating  time 
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APPENDIX  E  -  NUMERICAL  ANALYSIS  OF  MAINTAINABILITY  INDICES 

I.  OUTLINE:  The  following  outline  is  a  procedure  for  doing  a  minimum 
maintainability  numerical  analysis.  Discussion  to  follow  at  paragraph  II. 

A.  Compute  the  following  indices: 

1.  MTTR  (point  estimate). 

2.  Availability: 

a.  Inherent  (Ai). 

b.  Achieved  (Aa). 

c.  Operational  (Ao). 

3.  Maintenance  Ratio  (MR). 

B.  Special  Topics,  As  Required. 

II.  DISCUSSION: 

A.  Maintenance  Indices. 

1.  Mean-time-to-repair  (MTTR):  The  MTTR  is  that  ratio  of  the 
time  it  takes  at  a  specific  level  of  maintenance,  (AVUM,  AVIM)  to  repair  the 
test  item.  MTTR  can  also  be  calculated  as  an  overall  ratio  for  repair  of 
the  test  item.  When  examining  the  data  that  are  used  in  the  calculations, 
screen  the  excessive  maintenance  times  and  explain  the  reasons  why  they  were 
excessive  (i.e.,  inadequate  equipment  publications,  poor  design,  etc.). 
Calculate  the  MTTR  using  all  the  data  and  then  with  the  excessive  time 
removed.  The  MTTR  estimates  of  the  maintenance  time  will  depict  what  can  be 
expected  when  the  problems  are  corrected. 

2.  Availability.  The  availability  of  a  system  or  equipment  is 
the  probability  that  it  is  fully  operational  at  any  point  in  time  when 
operated  and  maintained  under  stated  conditions.  This  maintainability  index 
is  widely  used  in  the  armed  services  as  well  as  industry,  and  is  usually 
stated  in  terms  of  design  requirement,  or  operational  use.  Associated  terms 
are  (1)  Inherent  availability  (Ai),  the  design  standard;  (2)  Achieved  Avail¬ 
ability  (Aa),  actual  test  experience;  (3)  Operational  Availability  (Ao), 
actual  field  operational  environment. 

a.  Ai  (I nherent  Avai 1 abi 1 i ty) :  This  is  the  probability  of  oper¬ 
ational  availability  in  the  "ideal"  maintenance  and  operational  environment 
when  used  under  stated  conditions.  Ai  is  defined  as  follows: 

Ai  =  0T 

OT  +  TUM 
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Where:  OT  =  The  operating  time  during  a  stated  time  period. 

TUM  =  Total  unscheduled  active  maintenance  time  in  clock 
hours  during  the  stated  period. 

b.  Aa  (Achieved  Availability):  Achieved  availability  is  that 
ratio  of  the  operational  time  to  maintenance  down  time  experienced  during 
test.  Aa  is  defined  as  follows: 


Where:  SMT  =  Scheduled  maintenance  time. 

c.  Ao  (Operational  Availability):  Operational  availability  re¬ 
flects  the  best  estimate  of  the  true  availability  ratio  for  a  test  item  when 
calculated  utilizing  data  obtained  from  the  real  operational  environment. 
Operational  availability  reflects  all  of  the  subelements  for  calculating 
availability  and  can  be  summarized  as  the  ratio  of  uptime  divided  by  uptime 
plus  downtime.  More  explicitly,  operational  availability  is  defined  as 
follows: 

Ao  =  ST  *  OT 


In  the  developmental  test  environment  operational  availability  is  not  rele¬ 
vant  for  one  primary  reason:  The  ALDT  is  not  realistic  in  thispenvironment. 
In  accordance  with  TECOM  Supplement  1  to  4MC  Regulation  700-15y  cases  where 
Ao  is  required  and  in  cases  where  downtime  for  ALDT  factors  is  not  provided 
in  the  IEP/TDP  for  calculating  Ao,  the  installation/field  operating  activity 
will  estimate  these  items  based  jn  expert  judgment  and  military  experience. 

3.  MR  (Maintenance  Ratio).  The  maintenance  ratio  is  the  total 
maintenance  (scheduled  (preventative),  and  unscheduled  (corrective))  time 
divided  by  the  total  operating  time.  The  MR  is  expressed  as  follows: 

MR  =  SMT  +  TUM 


B.  SPECIAL  TOPICS:  AMC  Pamphlet  706-113^  presents  some  experi¬ 
mental  statistical  techniques  of  special  interest  to  the  developmental 
tester.  Chapters  15  and  16  present  techniques  for  comparing  the  performance 
of  a  new  product/system  to  that  of  a  standard.  Chapter  17  presents  the 
treatment  of  outliners  and  Chapter  21  presents  the  relation  between  confi¬ 
dence  intervals  and  tests  of  significance.  Specific  examples  are  provided 
in  the  AMCP  to  illustrate  each  statistical  technique. 
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